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Positive Lyapunov exponents measure the asymptotic exponential divergence of nearby 
trajectories of a dynamical system. Not only they quantify how chaotic a dynamical 
system is, but since their sum is an upper bound for the entropy by the Ruelle inequality, 
they also provide a convenient way to quantify the complexity of an active network. We 
present numerical evidences that for a large class of active networks, the sum of the 
positive Lyapunov exponents is bounded by the sum of the positive Lyapunov exponents 
of the corresponding synchronization manifold, the last quantity being in principle easier 
to compute than the latter. This fact is a consequence of the property that for an active 
network considered here, the amount of information produced is more affected by the 
interactions between the nodes than by the topology of the network. Using the inequality 
described above, we explain how to predict the behavior of a large active network only 
knowing the information provided by an active network consisting of two coupled nodes. 



1. Introduction 



The relation between topology and function in active networks, networks composed by 
nodes described by some intrinsic deterministic dynamics, is a fundamental question whose 
answer may help understand the collective behavior [ [1] of a variety of complex systems 
ranging from particle-like chemical waves [ |2] , light propagation in dieletric structures [ 
E], neural networks [d] and metabolic networks [ 5J. 

The work of Kuramoto [ [6] and the works of Pecora and collaborators [ [71 [8] laid the 
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foundations of a theoretical framework for studying the relation between topology and 
function in active networks. In particular, the latter opened up a new way to study the 
onset of complete synchronization in active networks [ [HI [IDl [H] composed of equal node 
dynamics. 

At the present moment, it is important to understand from a theoretical perspective the 
relation between the structure of a network (topology) and the behavior of it (function) 
in active networks whose nodes are not only far away from complete synchronization 
(desynchronous) but also nodes that interact among themselves simultaneously by linear 
and nonlinear means. 

In this work, we conjecture that an upper (or lower) bound for the sum of the Lyapunov 
exponents of an active network with some special properties [ [12] and an arbitrary size, 
formed by nodes possessing equal dynamics, can be analytically calculated by only using 
information coming from the behavior of two coupled nodes. We recall that by the Ruelle 
Formula [US], the sum of the positive Lyapunov exponents is an upper bound for the 
entropy. Hence, the sum of the positive Lyapunov exponents represent a convenient way 
to quantify the behavior of the network and therefore to measure how complex a network 
is. 

To describe our conjecture, we first introduce some concepts and ideas, illustrated by 
Fig. [H This figure represents the trajectory of two nodes X and y of a large network. The 
networks considered here admit a synchronous solution [see Eq. ([1])] and a desynchronous 
one. The position where this synchronous solution lies is pictorially represented by the 
dashed black line that represents a projection of the synchronization manifold of the 
network. The desynchronous solution is represented by the filled red regions localed off 
the diagonal. This solution represents a chaotic desynchronous trajectory. 

If the synchronous solution is unstable, initial conditions close to the synchronization 
manifold leave its neighborhood, eventually arriving at a desynchronous (stable) solution, 
a chaotic attractor. If the synchronous solution is stable, it is to be expected that complete 
synchronization takes place, when all nodes have equal trajectories. 

The Lyapunov exponents of the desynchronous solutions (a chaotic attractor) are cal- 
culated from Eq. ([3]), and the sum of the positive ones is denoted by A. The Lyapunov 
exponents of the synchronous solution are refered to as conditional Lyapunov exponents, 
and the sum of the positive ones is denoted by Ac. [[16]. 

Roughly speaking, our conjecture states that if for two (iV = 2) coupled nodes with 
equal dynamics and coupling strengths, the quantity A is greater (smaller) than Ac, then 
this inequality remains valid for N > 2 coupled nodes (with the same dynamics) with 
coupling strengths obtained by properly rescaling. 

Accordingly, given an interval for each coupling strength, the collection of all networks 
considered here can be classified in two classes : The class LOWER for which A > Ac 
(Ac is a lower bound for A) and the class UPPER for which A < Ac (Ac is an upper 
bound for A). While for the first class, a node forces another not to do what it is doing, 
inducing the nodes to stay out of synchrony, in the second class a node forces another to 
do what it is doing, inducing all the nodes to become synchronous. 

Naturally, if the nodes in the network becomes completely synchronous, then the syn- 
chronous solution becomes stable and A = Ac. 

It is often considered that the complexity of a network can be quantified by typical 
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characteristics as the average degree, the network's connecting topology, the minimal and 
maximal degree, the average or minimal path length connecting two nodes, and others. 
But these characteristics are a measure of the structure of the network and not of the 
behavior of it. In this work, at least for the class of networks considered here, we can state 
that these active networks behave in only two ways, regardless the many characteristics 
that quantify the network's structure: the behaviors UPPER and LOWER. In other 
words, if nodes of an active network with equal nodes interact by a coupling function that 
induces an LOWER (or UPPER) character, this character will not be modified by the 
use of other connecting topologies. 

To justify our conjecture, we use complex networks of linear and nonlinear maps coupled 
by linear terms, and neural networks of highly non-linear neurons (Hindmarsh-Rose (HR) 
neurons [ 17J) connected simultaneously by linear couplings (electrical synapses) and non- 
linear couplings (chemical synapses). 

We finally discuss how our conjecture can be used to predict whether a network formed 
by nodes that when isolated are chaotic (periodic) will maintain such a chaotic behavior, 
then predicting how complex larger networks can be. 




Figure 1. [Color online] Illustration of the two most relevant types of solutions we expect 
to find in the networks here considered. A synchronous solution whose trajectory is 
represented by the black dashed line, which lies on the synchronization manifold, and the 
desynchronous solution whose trajectory is represented by the red filled regions. The sum 
of the positive Lyapunov exponents of the synchronous solution is denoted by A,^ and the 
sum of the positive Lyapunov exponents of the desynchronous solution is denoted by A. 
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2. Active networks 

Consider an active network formed by > equal nodes Xi G M'^ with d > 2. The 
network is described by 

N N 

Xi = F(xi) + aJ2 6^uH(xj) + g C.,S(xi, xj), (1) 

i=i i=i 

where (7 G M and a > 0, ^ = {^jj} is a Laplacian matrix = 0) describing the 

way nodes are linearly coupled, C = {Cij} is the the adjacent matrix representing the 
way the nodes are connected by linear and non-linear function, and H : M*^ — > M'' and 
S : M'^ X M'^ ^ R'^ are arbitrary differentiable transformations. We also assume that Q 
and C commute. 

A solution of ([T]) is called synchronous if xi(t) = ■ ■ ■ = XN(t). To guarantee the existence 
of such solutions, we assume that every node of the network receives the same number 
k of incoming connections. In other words, we require that Ylj ^ij — ^ ^- It 

easy to see that this condition not only guarantees the existence of synchronous solution, 
but also implies that the d-dimensional linear subspace S = {xi = X2 = . . . = xn} is 
invariant. The set S is called synchronization manifold. Note that a synchronous solution 
Xj(t) = x(t) for i = 1, . . . , N satisfies the following ordinary differential equation 

i = F(x)+^A;S(x,x). (2) 

The way small perturbations 5xi, 5x2, . . . , ^x^v propagate in the network is described 
by the variational equations [ [7] associated to ([1]) 

TV 

= DF(xi)5xi + a J]^ijX)H(xj)5x, + (3) 

N 

g ^ CijDiS{xi, Xj)5xi + CijD2S{xi, Xj)5xj, 

where DiS{x,y) and D2S{x,y) denote the differential of S{x,y) with respect to x and y, 
respectively. From ([3]), we can calculate the Lyapunov exponents of every solution of ([1]). 
The network is assumed to be ergodic, and so the Lyapunov exponents Ai < A2 < ■ ■ ■ < 
Am for m = 1, ... , Nd are constant almost everywhere, and can be obtained by typical 
initial conditions. The Nd Lyapunov exponents of the synchronous solutions are called 
conditional Lyapunov exponents. We also assume that the dynamics restricted to the 
synchronization manifold S is ergodic. Hence, also the conditional Lyapunov exponents 
along synchronous solutions are constant almost everywhere on S. The ergodic invariant 
measure of ([1]) and that of the dynamics restricted to S (not necessarely the same) are 
assumed to be unique (singular) and different than a point (non-atomic). 

3. Conjecture 

Here, we describe our proposed conjecture in a more friendly way. For a more rigorous 
presentation of it, one should read the Appendix 19.11 
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Let }i,S,Q,C,a, g, N as in ([T]) to be the parameters which define the active network. 
H represents the function under which the nodes connect among themselves in a hnear 
fashion, S the function under which the nodes connect among themselves in a non-linear 
fashion, Q a Laplacian connecting matrix, C an adjacent connecting matrix, a the strength 
of the linear coupling and g the strength of the non-linear coupling. Finally, is the 
number of nodes. 

We say that a network is of the class UPPER if A > Ac and of the class LOWER if 
A< Ac- 

We consider that the UPPER and LOWER property holds for a properly rescaled 
coupling strength intervals a{N,g,C) G [am{N,g,C),(r*{N,g,C)] and g{N,g,C) e 
[gUN,g,C),g*{N,g,C)]. 

Conjecture: The LOWER or UPPER character of a network described by Eq. (QP is 
independent of the number of nodes for a properly rescaled coupling strength interval. 

In simple words, this conjecture states that as long as one preserves the coupling func- 
tions H, S under which nodes connect among themselves, there will be coupling strengths 
a, g for which the LOWER or UPPER character of an active network will be preserved, 
regardless of the number of nodes N. 

4. Defining the coupling strength intervals 

For simplicity in the notation, we ommit in the representation of the constants am, <y* 
and gm,g* the reference to their dependence on g,C. 

Our conjecture only states that whenever there is a network with A^^i nodes with a 
structure defined by H, S,^,C and this network has an UPPER (or lower) character for 
the coupling strength intervals [am{Ni) , a* (Ni)] and [gm{Ni) , g* (Ni)] then if a network 
with N2 nodes is constructed preserving the coupling functions H, S then there exists 
coupling strength intervals [am{Ni) , a* (Ni)] and [g^iNi), g*{Ni)] for which the network 
behaves with the same UPPER (or lower) character. 

To make this conjecture more practical, we make in the following some assumptions. 

The value of the constants am{N),a*{N) and gm{N),g*{N) are such that either 
WmiN)/gm{N)\ » 1 or \aUN)/gm{N)\ « 1 and \a* (N) / g* (N)] » 1 or \a* (N) / g* (N)] 
<< 1. The reason is because for such conditions, the values for these constants for a 
network with N > 2 nodes can be calculated from the values of these constants from the 
reference network, in here assumed to have N = 2 nodes. 

The network with Ni nodes is regarded to be the reference network and we consider 
that N2 > Ni. For simplicity, we further consider that Ni = 2. In addition, to make our 
analyses simpler, we consider in our numerical simulations a constant gm{N) = g*{N), 
and we choose either l^miN) / gm{N)\ >>1 or IcmiN) / gm{N)\ «1. 

Then, we choose the constant a*{N) such that its value is a little bigger than the 
smallest coupling values for which complete synchronization is reached and when A = Ac. 
However, other intervals could be considered. The reason again is that a*{N) can be 
analytical calculated from a*{N = 2), the linear coupling strength, for which complete 
synchronization is found in two mutually coupled systems. 

The constants that define the coupling strength interval for a network with N nodes can 
be calculated from the constants that define the coupling strength interval for a network 
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with N = 2 nodes using 



a{N) 



9iN) 



2a{N = 2) 

l72(iV)| 
g{N = 2) 



(4) 



(5) 



k 



where 72 is the second largest eigenvalue of Q, and k is the number of incoming connections 
of each node of the network. 

As an example of how we use Eq. (jl]), we do the following. Having defined that 
two mutually linearly coupled systems (so, g=0) have a LOWER character for the linear 
coupling strength interval [am{N = 2),a*{N = 2)], then we construct a network using 
the same linear coupling function composed of nodes, but considering now the linear 
coupling strength interval [am{N) , a* (N)] calculated using Eq. (jl]). According to our 
conjecture, such a network will have a lower character. 

For a more detailed analysis of how we derive Eqs. (jl]) and (j5]), one should read 
Appendix MM 

5. Networks of coupled maps 

Here, we consider only linear couplings. Then g = gm=0, and therefore, = 0. 

For general networks (discrete or continuous descriptions) whose nodes are completely 
synchronous, one always have that A = A^, a non generic case for which our conjecture 
can be proved. 

For networks of coupled maps, there is another trivial example when A = Ac. That 
happens for networks whose Jacobian is constant as networks formed by linear maps of 
the type x^^\^i = axn^ + 2a X^^i Gij^n ^ (mod 1) and when there exists complete synchro- 
nization, and the attractor lays on the synchronization manifold. These results concern 
arbitrary connecting Laplacian matrices Qij, for example, they would apply for map lattice 
with a coupling whose strength decreases with the distance as a power- law [[IS]- 

Now, imagine the following network 



with p > and s = ±1. The synchronization manifold is defined by Xn = Xn = 
. . . = xi^\ and in an all-to-all connecting topology, the Lyapunov exponent of the syn- 
chronization manifold can be calculated by A*^^-* = In (2) -|- 1/t In |1 + spx„|, with 
n = (1, . . . and the others A^ — 1 equal exponents associated to the transversal di- 
rections by A*^*-* = In (2) -|- l/t^„ln |1 + spxn — 2a\, for i > 2. In Fig. [21 we show the 
values of A and Ac as we vary a, for p = 0.5. In (A) and (C), we consider A^=2 (all-to-all 
topology), and in (B) and (D) we consider a random networks formed by A^=16 nodes. 
The coupling strength interval used for two coupled nodes was rescaled to the proper 
coupling strength interval for the larger random network, using in the denominator of 
Eq. (jl]) the value of I72I = 4.1542, relative to the second largest eigenvalue (in absolute 



N 




(6) 
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Figure 2. Results for the network in Eq. ([6]), for p=0.5. For (A) and (C), N=2, and for 
(B) and (D), A^=16. An inhibitory (UPPER) network is shown in (A) and (B), for s=-l, 
and an excitable (LOWER) network is shown in (C) and (D), for s=l. The horizontal 
axis in (B) and (D) were rescaled by a'=a * |72(A^ = 16)|/2, so that one can compare 
Figs. (B) and (D) with (A) and (C).|72(A^ = 16) | =4. 1542. 



value) of the random network. One can check that if two coupled nodes have an UPPER 
[LOWER] character for a given coupling interval as can be seen in Fig. [2]^A) [in Fig. 
[2](C)], larger networks will behave in the same UPPER [LOWER] character as can be 
seen in Fig. [2](B) [in Fig. EJ^D)]. 

The conjecture describes a relationship between the conditional exponents and the 
Lyapunov exponents. To see that, notice that, typically for the UPPER networks of 
linearly connected maps, we have Ai ~ A^^-*, a consequence of the fact that the largest 
Lyapunov exponent can be calculated using the same directions as the ones along the 
synchronization manifold. Thus, using our conjecture, if the network is of the UPPER 
type, Ai + A2 < A^^-* + \^'^\ which provides A2 < A'^^^ Otherwise, if the network is 
of the LOWER type, A2 > A^^). That can be checked in Figs. Wi,A)-{C). Since the 
approaching of the transversal conditional exponents to negative values are associated 
with the stabilization of a certain oscillation mode, close to a coupling strength for which a 
transversal conditional exponent approaches zero, there will also be a Lyapunov exponent 
which approaches zero, meaning that some oscillation in the attractor becomes stable. 
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6. Networks of Hindmarsh-Rose neurons 

Let us illustrate our conjecture in networks composed of coupled Hindmarsh-Rose 
neurons [^7\ electrically and chemically coupled [[20]: 

N 

= Hi ~\~ 32;j ~ — Zi -\- li -\- g ^ ^ CijS{xi, Xj) 

N 

+c^^GijXj (7) 
i=i 

Vi = l-5xf-yi; ij = -rz, + 4r(xi + 1.6), 



The parameter r modulates the slow dynamics and is set equal to 0.005, such that 
each neuron is chaotic. The synaptic chemical coupling is modeled by S{xi,Xj) = {xi — 

Vsyn)T{xj) where T{xj) = ^ ^ ^-e(xj-Qsyn) ^^^^ ^ -0.25, 9 = and Kj/n = 2.0. 
aQji is the strength of the electrical coupling between the neurons, and U = 3.25. In 
order to simulate the neuron network and to calculate the Lyapunov exponents through 
Eq. (fTTl) . we use for the node i the initial conditions Xi=-1.3078+uji, ?/j=-7.3218+co'j, and 
Zi=3.3530+uji, where Ui is an uniform random number within [0,0.02]. To calculate the 
conditional exponents A^*\ we use in Eq. (fT2l) the initial conditions, x=-1.3078, ?/=-7.3218, 
and 2;=3.3530, but any other set of typical equal initial conditions can be used [EI]- 

We study three types of neural networks, (i) g < [Figs. [3](A-C)]. The coupling 
(synapses) is said to be of the excitatory type, since Xi — Vgyn < and the nodes j 
contribute positively in the equations for the first derivative of Xj. In other words, the 
postsynaptic neuron {xi) is forced to opposite the presynaptic ones (xj); (ii) (7 = [Figs. 
|3]^D-F)]. The network has nodes coupled to other nodes only electrically. From the biolog- 
ical point of view, neurons only make electrical connections with their nearest neighbors. 
Here, we also consider long-range correlations. Since ex > 0, this coupling contributes neg- 
atively to the first derivative of Xj, which results in an inhibitory effect to the oscillatory 
motion of the neuron Xi. (iii) > [Figs. [3](G-I)]. The coupling (synapses) is said to be of 
the inhibitory type, since the nodes j contribute negatively in the equations for the first 
derivative of Xj. For such a case, the postsynaptic neuron (xj) is forced to synchronize its 
rithmus to the rithmus of the presynaptic ones (xj). 

In Fig. [3|, we show the values of A and Ac for the three types of neural networks being 
considered, case (i) in Figs. [3](A-C), case (ii) in Figs. [3](D-F), and case (iii) in Figs. [3]^G- 
I). Networks whose results are represented in Figs. [3](A-C) and (G-I) are constructed by 
neurons connected simultaneously electrically (a > 0) and chemically {g > 0) in the all-to- 
all topology, while networks whose results are represented in Figs. [3](D-F) are constructed 
by neurons connected only electrically (a > and g=0) in the all-to-all topology. 

In (A) [case (i)], for A^=2 and g = -0.01, A < Ac, for a = [0.1, 0.7]. So, amiN = 2)=0.1 
which leads to (Jm{N = 2)/gm{N = 2)| >> 1, as we wish. From our conjecture, for larger 
networks as the ones shown in Figs. EI^B) [N = 4] and[2](C) [A^=8], we must have A < Ac, 
for the rescaled coupling interval. From Eqs. (jl]) and we have for the network with 
= 4 [Fig. [3t^B)], the rescaled coupling strength interval should be a = [0.1/2,0.7/2] 
and g = —0.01/3, and for the network with A^ = 8 [Fig. [3](C)], the rescaled coupling 
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strength interval should be a = [0.1/4,0.7/4] and g = —0.01/7. In fact, as one sees in 
Figs. El^B-C), we indeed see that these networks have the same UPPER character as the 
network with N=2, for the considered coupling strength intervals. 

In (D) [case (ii)], for N=2 and c/ = 0, A < for a = [0, 0.6]. So, gm{N = 2) = and 
consequently CTm{N = 2) = 0. From our conjecture, for larger networks as the ones shown 
in Figs. [3](E) [A^ = 4] and [3](F) [A^=8], we must have A < A,^ for the rescaled coupling 
interval. From Eqs. (jl]) and ([S]), we have for = 4 [Fig. EI^E)], the rescaled coupling 
interval should be o" = [0, 0.6/2] and for N = 8 [Fig. [31(F)], the rescaled coupling interval 
should be cr = [0,0.6/4]. In fact, as one sees in Figs. [3](E-F), we indeed have that these 
networks have the same UPPER character of the network with N=2. 

Finally, In (G) [case (iii)], for N=2 and ^=10, A > Ac for a = [0.01, 1]. So, \gmiN = 
2)/am{N = 2)1 >> 1 as we wish. From our conjecture, for larger networks, as the ones 
shown in Figs. EJ^H) [N = 4] and [2](I) [A^=8], we must have A > A^ for the rescaled 
coupling interval. From Eqs. (jl]) and and = 4 [Fig. [31(H)], the rescaled coupling 
interval should he a = [0.01/2, 1/2] and ^=10/3, and for A^ = 8 [Fig. [3](I)], the rescaled 
coupling interval should be a = [0.01/4, 1/4] and g=10/7. In fact, as one see in Figs. [3](G- 
I), we indeed have that these networks have the same LOWER character of the network 
with A^=2. 

An inhibitory chemical coupling inhibits the nodes of the network, which means that 
such a coupling forders an increase in the level of synchronization. On the other hand, an 
excitatory chemical coupling excites the nodes, which means that such a coupling forders 
an increase in the level of desynchrony. 

It is intuitive to imagine that an excitatory network (as defined exclusively in terms 
of the chemical coupling) would have a LOWER characteristic and an inhibitory net- 
work (as defined exclusively in terms of the chemical coupling) would have an UPPER 
characteristic. That is why excitation would mean an increase of desorganization (more 
entropy) and inhibition an increase of synchronization (less entropy). However, we have 
previously shown in Figs. [3I^A-C) that an excitatory network (as usually defined in terms 
of the chemical coupling) has the UPPER characteristic and in Figs. [3](G-I) that an in- 
hibitory network (as usually defined in terms of the chemical coupling) has the LOWER 
characteristic. This aparent contradiction is simple to be explained. 

In the excitatory networks [Figs. [3](A-C)], the absolute strength of the non-linear (chem- 
ical) coupling (0.01) is smaller than the strength of the linear (electrical) coupling. As 
a consequence, the linear coupling prevails on the non-linear coupling. In the inhibitory 
networks [Figs. [31^A-C)], the strength of the non-linear (chemical) coupling (10) is much 
larger than the strength of the linear coupling. However, such a large strength effectively 
forders an excitatory behavior in the network. Notice that while in Fig. [3|(A) complete 
synchronization appears for a ~ 0.5, in Fig. [3]^G) complete synchronization appears for 
a ~ 0.95, and therefore, complete synchronization in the inhibitory network appears only 
for a larger linear coupling than the one for which complete synchronization appears in 
the excitatory networks. 

It is not the scope of this work to determine for which conditions an inhibitory (or 
excitatory) non-linear (chemical) couplings in networks of neurons simultaneously con- 
nected by linear and non-linear means determines the UPPER or LOWER character of 
a network. For that one should check Ref. [[TSj. Had we consider that the neurons were 
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connected exclusively by non-linear (chemical) means (cr = 0), then it is to be expected 
that inhibitory networks would present an UPPER character and excitatory networks 
would present a LOWER character. 




a a CT 



Figure 3. The values of A and Ac for neural networks described by Eq. ([7]) of nodes 
connected in an all-to-all topology. In (A),(D), and (G), N=2. In (B),(E), and (H), 
= 4. In (C), (F), (I), N=8. Results for networks with an UPPER character are shown 
in (A-F), and for networks with an LOWER character are shown in (G-I). 



7. Application of our conjecture to predict the chaotic behavior of large net- 
works 

In the following, we discuss how our conjecture can be used to make general statements 
about active networks. Consider the UPPER networks formed by neurons connected only 
electrically {g=0). For such cases, Ac(A^) is an upper bound for the Kolmogorov-Sinai 
(KS) entropy Hks (see [Il3]) and also an upper bound for A. Since networks formed by 
nodes connected in an all-to-all topology produce Laplacian matrices whose eigenvalues 
are 71 = 0, and '-fi=—N, for z = 2, . . . , A^, it is clear from Eq. (jlj) that max [Ac(A^)] for 
the considered coupling strengths of a network with the all-to-all topology, is larger or 
equal to max [A(7(A^)] for any other topology. Defining the network capacity, c{N), to be 
equal to max [Ac(A^)], calculated for the all-to-all topology (and the considered coupling 
intervals), since AciN) > A{N) (as well as Ac(L) > HKsiN) [[22]) for UPPER networks, 
we conclude that for these networks not only 



c{N) > max [A(A^)] 



(8) 
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but also 



c{N) > maic[HKs{N)] 



(9) 



where the max of A(A^) in taken considering "any" possible topologies (described in Fig. 
H]) and the considered coupling intervals. 



Figure 4. Representation of a few network topologies with 8 neurons, considered in this 
work. The filled balls represent neurons and the lines indicate an electric bidirectional 
coupling. In (A) the neurons are only coupled with its nearest neighbors, forming a ring. 
From (B) to (D) it is added to the network long-range bidirectional connections. The 
average number of connections that each neuron receives (network degree), uj, is uj=2, in 

(A) , uj=3, in (B), a;=5, in (C), and uj=7, in (D). In a network with N neurons, long-range 
connections are introduced in the initial ring by connecting each neuron to its N/2-th 

(B) neighbors, then to its (A^/2-l)-th neighbors (C), then to its {N/2 — l)-th neighbors, 
till each neuron is connected to its second neighbors, when the network has the all-to-all 
coupling topology. 

The value of c{N) for neural networks electrically connected can be approximately 
calculated by max (A*^^)) + (A^ — 1) max (A^) (notice that since A^^'' does not depend on a, 
then, max(A^^'') happens for the same coupling strength for which max(A^^'') is found), 
which leads to c{N) = 0.01362 -|- 0.1013(A^ - 1) bits/(time unit). By doing simulations 
considering networks as the ones represented in Fig. HI (with 10 < A^ < 40), we obtain 
that max [A{N)] ^ 0.0830 + 0.0230(A^ - l)bits/(time unit), which agrees with Eq. dH). 

For a network with the all-to-all topology [as in Fig. 111(D)], for A^ > 10, we obtain 
max [A(A^)] = 0.158447 + 0.031537(A^ - 1), which agrees with Eq. ([8]), because c{N) > 
max [A(A^)] (where the maximum is taken considering the all-to-all topology). Finally, if 
we construct a network with nodes connecting to their nearest neighbors forming a closed 
ring [as in Fig. \M.A)], we find max [A(Ar)] ^ 0.197125 + 0.034865(A^ - l)bits/(time unit). 
Equation ([H]) is once again verified. 

Thus, c{N) for electrically connected networks does not depend on the network topol- 
ogy. That is not the case for chemically connected neural networks, for which c{N) might 
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be achieved for different topologies, since the curve for A*^^-* and A*^*-* achieve their maximal 
values for different values of the coupling strength. 

Further, consider two coupled LOWER-type systems and A is null (positive) for some 
coupling strength, meaning a periodic behavior (meaning chaos). It might be that, for a 
proper rescaled coupling strength, as more nodes are added to the network, A becomes 
positive, meaning chaos (for sure there will be chaos). We can also use our conjecture 
to predict the behavior of a network constructed with nodes that are either chaotic or 
periodic, by only having information about two coupled nodes. Considering only linear 
couplings [g=0, in Eq. ([1])]. For cr < e, the two coupled nodes have a periodic dynamics, 
and thus, A = 0, but Ac > (UPPER character). That implies that as we add more 
nodes in the network, it might be that after the proper rescaling of the coupling strength 
the network becomes chaotic. 

8. Conclusions 

In conclusion, we have presented arguments to suggest that for a class of dynamical 
systems, the sum of all the positive Lyapunov exponents of an active network is bounded 
by the sum of all the positive Lyapunov exponents of the synchronization manifold. In 
practical terms, the entropy production of the synchronization manifold and its transversal 
directions (Ac) of a system of two coupled equal dynamical systems determines the upper 
(LOWER character) or lower (UPPER character) bound for the sum of the positive 
Lyapunov exponents of a large network. This fact enables one to predict the behavior of 
a large network by using information provided by only two coupled nodes. 

Our results indicate that the behavior (synchronization and information) of an active 
network with nodes possessing equal dynamics and especial properties [ [21] does not 
strongly depend on the coupling topology {Q and C) and the size of the network (A^) but 
rather on the nature of the coupling functions {S and H). 

At first glance, this result seems to be in direct conflict with what one would expect 
to find in realistic neural networks, as the mammalian brain, whose topology is possibly 
responsible for intelligence. But one should have in mind that the here considered networks 
are constructed with nodes that possess equal dynamics being connected using always the 
same coupling function. In realistic brain networks, the coupling functions largely differ 
along different brain areas as well as the coupling strength depends on time. Therefore, 
in order for the topology to play an important role in the behavior of a network one needs 
to consider networks with non-equal nodes and/or that possess coupling functions that 
change in space and time. 

Naturally, the large class of networks for which our conjecture applies are far from 
being realistic. However, we believe our conjecture can contribute to the understanding 
of much more complex networks. For example, for the UPPER networks, a large series 
of numerical results show that more realistic networks constructed with non-equal nodes 
(or networks of equal nodes but with random coupling strengths [[23]) have a KS entropy 
smaller than the networks with equal nodes. Therefore, even though networks with equal 
nodes might not be realistic, their entropy production is an upper bound for the entropy 
production of more realistic networks. 

Excitability and inhibition is a concept usually used to classify the way non-linear 
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(chemical) synapses between two neurons are done. When an inhibitory neuron spikes (the 
pre-synaptical neuron) a neuron connected to it (the post-synaptical neuron) is prevented 
to spike. When an excitatory neuron spikes it induces the post-synaptical neuron to spike. 
Intuitively, one should expect that an inhibitory (excitatory) coupling forders (prevents) 
synchronization, but we have shown two cases for which an excitatory network had an 
UPPER character and an inhibitory network had a LOWER character. The reason is 
that only the non-linear couplings (chemical synapses) are not sufficienty to define the 
LOWER and UPPER character of the network. One should consider the combined effect 
of the linear (electrical) and of the non-linear couplings (chemical). For more details about 
that, see Ref. [[H] 

For UPPER networks, the entropy of the attractors cannot be larger than the entropy 
of the synchronous set, which therefore imposes a clear limit in the complex character of 
these networks. On the hand, for LOWER networks, our conjecture states that such a 
limit is unknown. 

This conjecture might be a consequence of the fact that the attractors and behaviors 
that appear in two coupled nodes for a given coupling strength are similar to the ones 
that appear for larger networks, to parameters rescaled according to Eqs. (jl]) and ([5]). In 
fact, as one can see in the work that is indeed the case for the coupling strengths 

for which burst phase synchronization (BPS) or phase synchronization (PS) appear in 
networks of electrically coupled HR-neurons. 

9. Appendix 

9.1. The conjecture 

Let H, S, Q, C, a, g, as in ([1]) to be the parameters which defines the active network. 
H represents the function under which the nodes connects among themselves in a linear 
fashion, S the function under which the nodes connects among themselves in a non-linear 
fashion, Q a Laplacian connecting matrix, C an adjacent connecting matrix, a the strength 
of the linear coupling and g the strength of the non-linear coupling. Finally, is the 
number of nodes. 

Denote by A(li,S,Q ,C,a, g, N) and Ac(ii,S,Q,C,a, g, N) the sum of the posititve 
Lyapunov exponents and the sum of the positive conditional Lyapunov exponents of the 
network whose structure is specified by (H, S, Q, C), respectively. We say that the couple 
(H, S) makes the network to be of the LOWER class if for every {Q, C) there exist four 
positive constants cxm, gm, c* and g* such that 

Ac(H, S, C, a, g) > A(H, S, C, a, g) (10) 

for all < cr < (T* and all gm ^ g ^ g* ■ An UPPER class active network is defined 
similarly by reversing the direction of inequality (fTOl) . 

Conjecture: Given a network with a LOWER (UPPER) character [as defined in (ITUI) ] 
specified by (H, S, g, C), and {g, C) with Ni nodes, there exist coupling strength intervals 
Cm < c < c* and (fm ^ g ^ g* for which a network specified by (H, S,^,C) and (^,C) 
with A^2 nodes has also a LOWER (UPPER) character. 
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9.2. Derivation of the coupling strength constants 

The variational equation ([2]) for the synchronous solution can be written as follows 

S± = {I®DF{x) + ag0DU{x)+gC0DiS{x,x) 

+ c/A;C® D2S(x,x)}5X, (11) 

where (5X is the column vector of M^'^ with components 5xi, 5x2, . . . , 5xiv, and stands 
for the Kronecker product of matrices. Since Q and C commute, they can be simultane- 
ously diagonalized. Let Ui, . . . , uat be their eigenvectors, and denote by 71, . . . , 7^r and 
7i, . . . , 77V the corresponding eigenvalues for Q and C, respectively. We order {7j} so that 
7i = 0. If we write 5X(t) = J2i<i<N ^« ® yi(^) with yi(t) G M*^, and substitute it in (ITT]) , 
then a straightforward computation gives 

y, = {DF(x) + (T7.OT(x) + (7fcDiS(x,x) + (77i^2S(x,x)}y,. (12) 

While Eq. (ITTl) describes how perturbations are propagated or damped along a partic- 
ular node of the network (xi) Eq. f|T2|) describes how perturbations are propagated along 
an eigenmode (y,). While Eq. fflTl) is valid for networks with nodes initially set in typical 
initial conditions Eq. f|T2l) is only valid for networks with nodes initially set with equal 
initial conditions, the assumption done in order to place Eq. flTT]) in the eigenmode form 
in Eq. ([T^. 

Calculating the Lyapunov exponents from Eq. assuming equal initial conditions 
for every node provides the same exponents than the conditional ones obtained from Eq. 
(fT2l) . An advantage of using Eq. (fT2|) for the calculation of the conditional exponents 
is that while Eq. (fTTl) requires the employement of Nd x Nd dimensional matrices, the 
conditional exponents by Eq. fll2p requires the use of N matrices of dimensionality d. 
A mode i in equation in Eq. (IT^ provides a set of d conditional exponents, denoted by 
A^*'', j = l,...,d. Since we are only interested in positive exponents, we simplify the 
notation by making A*^*) = Yl'j=i ■^^j^- refers to the sum of the positive conditional 

Lyapunov exponents of the synchronization manifold while A'-*-' {i > 2) refer to the sum 
of the positive Lyapunov exponents of the transversal directions to the synchronization 
manifold. 

From Eq. (fT2|) it becomes clear that once the conditional exponents are calculated using 
two bidirectionally coupled nodes, for the considered coupling interval, the conditional 
exponents of the mode i (A*^*-*) for larger networks with arbitrary topology can be calculated 
from the exponents for N=2, by A^^) (A^ = 2, a, g) = A^^) (A^, a, g/k) and A^^) (A^ = 2, a, g) = 
A«(Ar,2a/|7.(Ar)|,(?/fc). 

To understand why, just make in Eq. (|T2|) g = 0. The only term that changes in 
these equations as one considers networks with different topologies and sizes is 7i(A^), the 
i — th eigenvalue of the connecting Laplacian matrix Q with size A^. Denoting 7j(A^ = 2) 
and a{N = 2) to be the i — th eigenvalue of the Laplacian matrix Q and the coupling 
strength, respectivelly, for two mutually coupled nodes then the mode i of Eqs. f|T2|) for 
a network with a number A^ of nodes will preserve the form of the mode i in Eqs. f[T^ 
for the network with A^ = 2 if a{N) = 2a{N = 2)/|7j(A^)|. For practical purposes, this 
relation can be expressed in terms of only the coupling strengths. Denoting a as the 
strength value for the linear coupling for which A*^^''(A^ = 2) reaches a given value, then 
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the coupling strengths for which A'-*-'(A^) reaches the same value is given by the rescaling 

2a{N = 2) 



aiN) 



A similar analysis can be done assuming that a=0. Once that Z)2S(x, x) << Z?iS(x, x) in 
Eq. ()12p . then the only term that changes in these equations as one considers networks with 
different topologies and sizes is k{N), the number of connections a node within a network of N 
nodes receives from the other nodes. So, denoting g as the strength values for the non-linear 
coupling for which A^^^(A^ = 2) reaches a given value, then the coupling strength for which 
;\(*)(JY) reaches the same value is given by the rescaling [I18| 

m = ^ 

As shown in Ref. [HB]) Eqs. ([ID and (0) remain valid if either \d'/g\ >> 1 or \g/^\ >> 1, 
which means that one can consider the linear coupling as a perturbation (|5/it| >> 1) or the 
nonlinear coupling as a perturbation (|ct/5| >> 1). 

Further in this work, the coupling interval is rescaled using as a reference the second largest 
conditional exponent A^^^ computed for the network with N=2. 
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